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PRIORITY 

5 This application claims priority under 35 U.S.C. § 119 to an application 

entitled "Device and Method for Binarizing Image" filed in the Korean 
Intellectual Property Office on January 30, 2003 and assigned Serial No. 2003- 
6420, the contents of which are incorporated herein by reference. 

1 0 BACKGROUND OF THE INVENTION 

Field of the Invention: 

The present invention relates generally to a device and method for 
binarizing an image, and in particular, to a device and method for preprocessing 
15 an input image into a binary signal before recognizing characters in the input 
image. 

Description of the Related Art: 

Generally, a preprocessing operation is performed to recognize image 
20 characters. "Preprocessing operation" refers an operation of processing an image 
before recognition of characters in the image. The image preprocessing operation 
can include an operation of deciding whether or not an input image is appropriate 
for character recognition, an operation of correcting a skew of an object in an 
input image, an operation of properly correcting a size of an input image, and an 
25 operation of binarizing an input image so that characters in the input image can 
be recognized. 

FIG. 1 is a block diagram illustrating the structure of a conventional 
binarization device for binarizing an image. The binarization device shown in 
30 FIG. 1 uses a quadratic filter. The quadratic filter is disclosed in a reference 



entitled "A Polynomial Filter for the Preprocessing of Mail Address Images," by 
P. Fontanot and G. Ramponi et al., Proc. 1993 IEEE Winter Workshop on 
Nonlinear Digital Signal Processing, Tampere, Finland, Jan. 1993, pp.2. 1-2.6, the 
contents of which are incorporated herein by reference. 

5 

Operation of the quadratic filter will now be described. A first threshold 
selection part 11 calculates a first threshold Thl used for classifying pixels of an 
image into character pixels and background pixels. A mean computation part 13 
classifies the pixels of the image into character pixels and background pixels on 

10 the basis of the first threshold Thl, and computes their mean values. A 
normalization part 1 5 converts pixels of the input image into values close to 6 1' 
or '0' using mean values of the character pixels and the background pixels, 
output from the mean computation part 13. It is assumed herein that the 
normalization part 1 5 converts the character pixels into a value close to ' l 5 and 

15 the background pixels into a value close to 4 0\ A quadratic operation part 17 
performs the operation of enhancing edges of the normalized pixels using 
relations between a given central pixel and its neighboring pixels with respect to 
the respective pixels. A denormalization part 19 performs the operation of 
denormalizing the edge component-enhanced pixels output from the quadratic 

20 operation part 17 in the range of their original pixel values. A second threshold 
selection part 21 calculates a second threshold Th2 used for classifying the 
denormalized pixels into character pixels and background pixels. 

Simple binarization part 30 converts the pixels output from the 
25 denormalization part 19 into two specific brightness values on the basis of the 
second threshold Th2. 

When such binarization is performed on the entire image photographed 
in an irregularly lighted situation, however, with a shadow thrown thereon, 
30 binarization performance deteriorates undesirably. 
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SUMMARY OF THE INVENTION 



It is, therefore, an object of the present invention to provide a device and 
5 method for classifying an image into character blocks and background blocks 
before binarization. 

It is another object of the present invention to provide a device and 
method for classifying an image into character blocks and background blocks, 
10 growing the classified character blocks to reclassify the character blocks, before 
binarization. 

It is further another object of the present invention to provide a device 
and method for classifying an image into character blocks and background 
1 5 blocks, grouping the classified character blocks with their neighboring blocks to 
enhance edge components, and separating the character blocks from the grouped 
blocks, before binarization. 

It is yet another object of the present invention to provide a device and 
20 method for classifying an image into character blocks and background blocks, 
growing the classified character blocks to reclassify the character blocks, 
grouping the classified character blocks with their neighboring blocks to enhance 
edge components, and separating the character blocks from the grouped blocks, 
before binarization. 

25 

It is still another object of the present invention to provide a device and 
method for classifying an image into character blocks and background blocks, 
enhancing edge components of the character blocks using a quadratic filter, and 
then binarizing pixels of the character blocks and the background blocks. 

30 
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It is still another object of the present invention to provide a device and 
method for classifying an image into character blocks and background blocks, 
enhancing edge components of the character blocks using an improved quadratic 
filter, and then binarizing pixels of the character blocks and the background 
5 blocks. 

In accordance with one aspect of the present invention, there is provided 
a device for binarizing an image, comprising an input part for receiving an 
image, a block classification part for dividing the received image into blocks, and 

10 classifying the divided blocks into character blocks and background blocks, an 
edge enhancement part for enhancing edges of a character block using relations 
between neighboring pixels in the character block classified by the block 
classification part, and generating a threshold for distinguishing character pixels 
and background pixels of the character block, and a binarization part for 

1 5 binarizing pixels of character blocks output from the edge enhancement part into 
a first brightness value for character pixels and a second brightness value for 
background pixels by comparing the pixels of the character blocks with the 
threshold, and binarizing pixels of background blocks output from the block 
classification part into the second brightness value. 

20 

In accordance with another aspect of the present invention, there is 
provided a device for binarizing an image, comprising an input part for receiving 
an image, a block classification part for dividing the received image into blocks, 
and classifying the divided blocks into character blocks and background blocks, a 

25 block growing part for growing the classified character blocks, and restoring a 
block containing a character pixel, classified as a background block, to a 
character block, and an edge enhancement part for enhancing edges of a 
character block using relations between neighboring pixels in the character block 
output from the block growing part, and generating a threshold for distinguishing 

30 character pixels and background pixels of the character block. The device for 
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binarizing an image further comprises a binarization part for binarizing pixels of 
character blocks output from the edge enhancement part into a first brightness 
value for character pixels and a second brightness value for background pixels by 
comparing the pixels of the character blocks with the threshold, and binarizing 
5 pixels of background blocks output from the block growing part into the second 
brightness value. 

In accordance with further another aspect of the present invention, there 
is provided a device for binarizing an image, comprising an input part for 

10 receiving an image, a block classification part for dividing the received image 
into blocks, and classifying the divided blocks into character blocks and 
background blocks, a block grouping part for grouping a character block 
classified by the block classification part with its neighboring blocks, thereby 
generating a grouped block, and an edge enhancement part for enhancing edges 

1 5 of the character block using relations between neighboring pixels in the grouped 
block, and generating a threshold for distinguishing character pixels and 
background pixels of the character block. The device for binarizing an image 
further comprises a block splitting part for separating the character block from 
the grouped block output from the edge enhancement part, and a binarization part 

20 for binarizing pixels of the separated character block into a first brightness value 
for character pixels and a second brightness value for background pixels by 
comparing the pixels of the separated character block with the threshold, and 
binarizing pixels of the background block output from the block classification 
part into the second brightness value. 

25 

In accordance with still another aspect of the present invention, there is 
provided a device for binarizing an image, comprising an input part for receiving 
an image, a block classification part for dividing the received image into blocks, 
and classifying the divided blocks into character blocks and background blocks, a 
30 block growing part for growing the classified character block, and restoring a 
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block containing a character pixel, classified as a background block, to a 
character block, and a block grouping part for grouping a character block output 
from the block growing part with its neighboring blocks, thereby generating a 
grouped block. The device for binarizing an image further comprises an edge 
5 enhancement part for enhancing edges of the character block using relations 
between pixels in the grouped block, and generating a threshold for 
distinguishing character pixels and background pixels of the character block, a 
block splitting part for separating the character block from the grouped block 
output from the edge enhancement part, and a binarization part for binarizing 
10 pixels of the separated character blocks into a first brightness value for character 
pixels and a second brightness value for background pixels by comparing the 
pixels of the separated character blocks with the threshold, and binarizing pixels 
of a background block output from the block growing part into the second 
brightness value. 

15 

In accordance with still another aspect of the present invention, there is 
provided a method for binarizing an image, comprising the steps of receiving an 
image,; dividing the received image into blocks, and classifying the divided 
blocks into character blocks and background blocks, enhancing edges of a 

20 character block using relations between neighboring pixels in the character block, 
and generating a threshold for distinguishing character pixels and background 
pixels of the character block, and binarizing pixels of the edge-enhanced 
character blocks into a first brightness value for character pixels and a second 
brightness value for background pixels by comparing the pixels of the character 

25 blocks with the threshold, and binarizing pixels of the classified background 
blocks into the second brightness value. 

In accordance with still another aspect of the present invention, there is 
provided a method for binarizing an image, comprising the steps of receiving an 
30 image, dividing the received image into blocks, and classifying the divided 



-6- 



blocks into character blocks and background blocks; growing the classified 
character blocks, and restoring a block containing a character pixel, classified as 
a background block, to a character block, enhancing edges of a character block 
using relations between neighboring pixels in the character block, and generating 
5 a threshold for distinguishing character pixels and background pixels of the 
character block, and binarizing pixels of the edge-enhanced character blocks into 
a first brightness value for character pixels and a second brightness value for 
background pixels by comparing the pixels of the character blocks with the 
threshold, and binarizing pixels of the background blocks into the second 
10 brightness value. 

In accordance with still another aspect of the present invention, there is 
provided a method for binarizing an image, comprising the steps of receiving an 
image, dividing the received image into blocks, and classifying the divided 

15 blocks into character blocks and background blocks, grouping the classified 
character block with its neighboring blocks, thereby generating a grouped block, 
enhancing edges of the character block using relations between neighboring 
pixels in the grouped block, and generating a threshold for distinguishing 
character pixels and background pixels of the character block, and separating the 

20 character block from the edge-enhanced grouped block. The method for 
binarizing an image further comprises binarizing pixels of the separated character 
block into a first brightness value for character pixels and a second brightness 
value for background pixels by comparing the pixels of the separated character 
block with the threshold, and binarizing pixels of the background block into the 

25 second brightness value. 

In accordance with still another aspect of the present invention, there is 
provided a method for binarizing an image, comprising the steps of receiving an 
image, dividing the received image into blocks, and classifying the divided 
30 blocks into character blocks and background blocks; growing the classified 



character block, and restoring a block containing a character pixel, classified as a 
background block, to a character block, grouping the character block with its 
neighboring blocks, thereby generating a grouped block, and enhancing edges of 
the character block using relations between pixels in the grouped block, and 
5 generating a threshold for distinguishing character pixels and background pixels 
of the character block. The method for binarizing an image further comprises 
separating the character block from the grouped block, and binarizing pixels of 
the separated character blocks into a first brightness value for character pixels 
and a second brightness value for background pixels by comparing the pixels of 
10 the separated character blocks with the threshold, and binarizing pixels of the 
background blocks into the second brightness value. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 The above and other objects, features and advantages of the present 

invention will become more apparent from the following detailed description 
when taken in conjunction with the accompanying drawings in which: 

FIG. 1 is a block diagram illustrating a structure of a conventional image 
binarization device; 

20 FIG. 2 is a block diagram illustrating a structure of an image binarization 

device according to a first embodiment of the present invention; 

FIG. 3 is a block diagram illustrating a structure of an image binarization 
device according to a second embodiment of the present invention; 

FIG. 4 is a block diagram illustrating a structure of an image binarization 
25 device according to a third embodiment of the present invention; 

FIG. 5 is a block diagram illustrating a structure of an image binarization 
device according to a fourth embodiment of the present invention; 

FIG. 6 is a block diagram illustrating a detailed structure of the block 
classification part of FIGs. 2 to 5 according to an embodiment of the present 
30 invention; 
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FIG 7 A is a diagram illustrating a comparison of energy distributions of 
DCT coefficients for the character blocks and the background blocks; 

FIG. 7B is a diagram illustrating an energy distribution characteristic of 
DCT coefficients for the character blocks; 
5 FIG 7C is a diagram illustrating the dominant DCT coefficients used in a 

block classification process; 

FIG 8 is a block diagram illustrating an example of the edge 
enhancement part of FIGs. 3 to 6 according to an embodiment of the present 
invention; 

10 FIG 9 shows a central pixel and its surrounding pixels processed by the 

quadratic operation part according to an embodiment of the present invention; 

FIG 10 is a block diagram illustrating another example of the edge 
enhancement part of FIGs. 3 to 6 according to an embodiment of the present 
invention; 

15 FIGs. 11A to 11C are diagrams illustrating a comparison of output 

characteristics between a quadratic filter and an improved quadratic filter in a 
binarization device according to an embodiment of the present invention; 

FIG 12 is a flowchart illustrating an image binarization method 
according to a first embodiment of the present invention; 
20 FIG 13 is a flowchart illustrating an image binarization method 

according to a second embodiment of the present invention; 

FIG 14 is a flowchart illustrating an image binarization method 
according to a third embodiment of the present invention; 

FIG. 15 is a flowchart illustrating an image binarization method 
25 according to a fourth embodiment of the present invention; 

FIG. 16 is a flowchart illustrating the block classification process of 
FIGs. 12 to 15 according to an embodiment of the present invention; 

FIG 17 is a flowchart illustrating the binarization process of FIGs. 12 to 
1 5 according to an embodiment of the present invention; 
30 FIG. 18 is a flowchart illustrating an image binarization method when the 
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quadratic filter is used in accordance with an embodiment of the present 
invention; 

FIGs. 19A to 191 are diagrams illustrating images generated in each step 
of the binarization procedure of FIG. 18; 
5 FIG. 20 is a flowchart illustrating an example of an image binarization 

method where the improved quadratic filter is used in accordance with an 
embodiment of the present invention; and 

FIGs. 21 A to 2 1G are diagrams illustrating images generated in each step 
of the binarization procedure of FIG. 20. 

10 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following description, specific details such as a size of an image 
and sizes of character and background blocks are provided for a better 
15 understanding of the present invention. It would be obvious to those skilled in the 
art that the invention can be easily implemented without such specific details or 
by modifying the same. 

In embodiments of the present invention, an input image is assumed to 
20 have a size of 640x480 pixels. The term "block" refers to character and 
background blocks, and it is assumed herein that each of the blocks has a size of 
8x8 pixels. In addition, the term "grouped block" refers to a block made by 
grouping a character block to be binarized with its 8 neighboring blocks, and it is 
assumed herein that the grouped block has a size of 24x24 pixels. 

25 

Preferred embodiments of the present invention will now be described in 
detail with reference to the annexed drawings. 

FIG 2 is a block diagram illustrating a structure of a binarization device 
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according to a first embodiment of the present invention. Referring to FIG. 2, an 
input part 110 has the function of receiving an input image. A camera, scanner, a 
communication interface including a modem and a network, and a computer, 
among other devices, can serve as the input part 110. It is assumed herein the 
5 input image is comprised of 640 (column) x 480 (row) pixels. 

Block classification part 120 divides the input image received from the 
input part 110 into blocks having a preset block size, and classifies the divided 
blocks into character blocks and background blocks by analyzing pixels included 
10 in the divided blocks. The block classification part 120 classifies the divided 
blocks into character blocks and background blocks in order to optionally 
perform binarization on a region where characters are included. It is assumed 
herein that each of the blocks has a size of 8x8 pixels. 

15 Edge enhancement part 130 enhances edges of the character blocks using 

relations between character pixels and their neighboring pixels in the character 
blocks classified by the block classification part 120, and generates pixels in 
which noise components are reduced. In addition, the edge enhancement part 130 
calculates a threshold Th2 used for binarizing the pixels. The edge enhancement 

20 part 130 can include a quadratic filter or an improved quadratic filter. 

Binarization part 140 compares the pixels of the character blocks output 
from the edge enhancement part 130 with the threshold Th2, and binarizes 
character pixels and background pixels into a first brightness value and a second 
25 brightness value, respectively. In addition, the binarization part 140 binarizes the 
pixels of the background pixels output from the block classification part 1 20 into 
the second brightness value. The binarization part 140 can include a compressor 
that compresses the binarized image before the binarized image is sent to a 
recognition part 150, so that efficiency of storage space can be improved. 
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Recognition part 150 recognizes the binarized signal output from the 
binarization part 140. 

5 FIG. 3 is a block diagram illustrating a structure of a binarization device 

according to a second embodiment of the present invention. Referring to FIG. 3, 
an input part 110 has a function of receiving an input image. A camera, scanner, a 
communication interface including a modem and a network, and a computer, 
among other devices, can serve as the input part 110. It is assumed herein the 
10 input image is comprised of 640 (column) x 480 (row) pixels. 

Block classification part 120 divides the input image received from the 
input part 110 into blocks having a preset block size, and classifies the divided 
blocks into character blocks and background blocks by analyzing pixels included 
15 in the divided blocks. The block classification part 120 classifies the divided 
blocks into character blocks and background blocks in order to optionally 
perform binarization on a region where characters are included. It is assumed 
herein that each of the blocks has a size of 8x8 pixels. 

20 A block growing part 160 extends the character blocks classified by the 

block classification part 120. In the block classification process, a block 
containing character pixels can be incorrectly classified as a background block 
due to the influence of the background between character pixels. The block 
growing part 160 grows the character blocks in order to extend pixels in a 

25 character block erroneously classified as a background block. 

Edge enhancement part 130 enhances edges of the character blocks using 
relations between character pixels and their neighboring pixels in the character 
blocks output from the block growing part 160, and generates pixels in which 
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noise components are reduced. In addition, the edge enhancement part 130 
calculates a threshold Th2 used for binarizing the pixels. The edge enhancement 
part 130 can include a quadratic filter or an improved quadratic filter. 

Binarization part 140 compares the pixels of the character blocks output 
from the edge enhancement part 130 with the threshold Th2, and binarizes 
character pixels and background pixels into a first brightness value and a second 
brightness value, respectively. In addition, the binarization part 140 binarizes the 
pixels of the background pixels output from the block growing part 160 into the 
second brightness value. The binarization part 140 can include a compressor that 
compresses the binarized image before the binarized image is sent to a 
recognition part 150, so that efficiency of storage space can be improved. 

Recognition part 150 recognizes the binarized signal output from the 
15 binarization part 140. 

FIG. 4 is a block diagram illustrating a structure of a binarization device 
according to a third embodiment of the present invention. Referring to FIG. 4, an 
input part 110 has a function of receiving an input image. A camera, scanner, a 
20 communication interface including a modem and a network, and a computer, 
among other devices, can serve as the input part 110. It is assumed herein the 
input image is comprised of 640 (column) x 480 (row) pixels. 

Block classification part 120 divides the input image received from the 
25 input part 110 into blocks having a preset block size, and classifies the divided 
blocks into character blocks and background blocks by analyzing pixels included 
in the divided blocks. The block classification part 120 classifies the divided 
blocks into character blocks and background blocks in order to optionally 
perform binarization on a region where characters are included. It is assumed 
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herein that each of the blocks has a size of 8x8 pixels. 

Block grouping part 170 groups each of the character blocks output from 
the block classification part 120 with its 8 neighboring blocks, thereby generating 
5 grouped blocks. If a threshold is determined to discriminate background "and 
character pixels using only one character block for the binarization process, 
discontinuity between blocks of the binarized image can occur as the difference 
between the determined threshold and a threshold of neighboring character 
blocks is very large. The block grouping part 170 performs the grouping function 
10 in order to extend a character block region and enhance the reliability of the 
binarization for the character block. 

Edge enhancement part 130 enhances edges of the character blocks using 
relations between character pixels and their neighboring pixels in the grouped 
1 5 character blocks output from the block grouping part 1 70, and generates pixels in 
which noise components are reduced. In addition, the edge enhancement part 130 
calculates a threshold Th2 used for binarizing the pixels. The edge enhancement 
part 130 can include a quadratic filter or an improved quadratic filter. 

20 Block splitting part 180 receives the grouped blocks from the edge 

enhancement part 130, and separates the character blocks from the grouped 
blocks. Block splitting part 180 performs the function of separating only 
character blocks for binarization from the blocks grouped by the block grouping 
part 170. 

25 

Binarization part 140 compares the pixels of the character blocks 
separated by the block splitting part 180 with the threshold Th2, and binarizes 
character pixels and background pixels into a first brightness value and a second 
brightness value, respectively. In addition, binarization part 140 binarizes the 
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pixels of the background pixels output from the block classification part 120 into 
the second brightness value. Binarization part 140 can include a compressor that 
compresses the binarized image before the binarized image is sent to a 
recognition part 150, so that efficiency of a storage space can be improved. 

5 

Recognition part 150 recognizes the binarized signal output from the 
binarization part 140. 

FIG. 5 is a block diagram illustrating a structure of a binarization device 
10 according to a fourth embodiment of the present invention. Referring to FIG. 5, 
an input part 110 has a function of receiving an input image. A camera, scanner, a 
communication interface including a modem and a network, and a computer, 
among other devices, can serve as the input part 110. It is assumed herein the 
input image is comprised of 640 (column) x 480 (row) pixels. 

15 

Block classification part 120 divides the input image received from the 
input part 110 into blocks having a preset block size, and classifies the divided 
blocks into character blocks and background blocks by analyzing pixels included 
in the divided blocks. Block classification part 120 classifies the divided blocks 
20 into character blocks and background blocks in order to optionally perform 
binarization on a region where characters are included. It is assumed herein that 
each of the blocks has a size of 8x8 pixels. 

Block growing part 160 extends the character blocks classified by the 
25 block classification part 120. In the block classification process, a block 
containing character pixels can be incorrectly classified as a background block 
due to the influence of a background between character pixels. The block 
growing part 160 grows the character blocks in order to extend pixels in a 
character block erroneously classified as a background block. 
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Block grouping part 1 70 groups each of the character blocks output from 
the block growing part 160 with its 8 neighboring blocks, thereby generating 
grouped blocks. If a threshold is determined to discriminate background and 
5 character pixels using only one character block (consisting of 8x8 pixels) for the 
binarization process, discontinuity between blocks of the binarized image can 
occur as the difference between the determined threshold of the one character 
block being small in size and a threshold of neighboring character blocks is very 
large. Block grouping part 170 performs the grouping function in order to extend 
10 a character block region and enhance the reliability of the binarization for the 
character block. 

Edge enhancement part 130 enhances edges of the character blocks using 
relations between character pixels and their neighboring pixels in the grouped 
15 character blocks output from the block grouping part 170, and generates pixels in 
which noise components are reduced. In addition, the edge enhancement part 130 
calculates a threshold Th2 used for binarizing the pixels. Edge enhancement part 
130 can include a quadratic filter or an improved quadratic filter. 

20 Block splitting part 180 receives the grouped blocks from the edge 

enhancement part 130, and separates the character blocks from the grouped 
blocks. Block splitting part 180 performs the function of separating only 
character blocks for binarization from the blocks grouped by the block grouping 
part 170. 

25 

Binarization part 140 compares the pixels of the character blocks 
separated by the block splitting part 180 with the threshold Th2, and binarizes 
character pixels and background pixels into a first brightness value and a second 
brightness value, respectively. In addition, the binarization part 140 binarizes the 
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pixels of the background pixels output from the block growing part 160 into the 
second brightness value. Binarization part 140 can include a compressor that 
compresses the binarized image before the binarized image is sent to a 
recognition part 150, so that efficiency of a storage space can be improved. 

5 

Recognition part 150 recognizes the binarized signal output from the 
binarization part 140. 

As described above, the binarization device according to a first 
10 embodiment of the present invention classifies an input image into blocks, and 
then classifies the divided blocks into character blocks and background blocks. 
The binarization device classifies the input image into character blocks and 
background blocks, in order to perform edge enhancement and binarization 
operations on the pixels in the character blocks and to fix pixels in the 
15 background blocks to a specified brightness value in a binarization process. 

Compared with the binarization device according to the first 
embodiment, the binarization device according to the second embodiment grows 
the character blocks classified by the block classification part 120 before edge 
20 enhancement, in order to prevent character pixels from being included in a 
background block in the block classification process. In the second embodiment, 
the classified character blocks are grown, and thereafter, if character pixels are 
included in a block erroneously classified as a background block, the block is 
corrected. 

25 

Compared with the binarization device according to the first 
embodiment, the binarization device according to the third embodiment groups 
character blocks classified by the block classification part 120 with their 
neighboring blocks before edge enhancement, enhances edges of the grouped 
30 blocks, separates the original character blocks from the edge-enhanced groups, 
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and then performs binarization on the separated character blocks. The reason for 
performing block grouping on the character blocks is as follows. Since the 
character block consists of a very small number of pixels, the character block is 
grouped with its neighbor blocks to extend its block region, so that edges of the 
5 grouped block are enhanced. 

Finally, compared with the binarization device according to the first 
embodiment, the binarization device according to the fourth embodiment further 
includes the block growing part 160 and the block grouping part 170. A detailed 
10 description of the fourth embodiment of the present invention will now be made.. 
In addition, it will be assumed that the image used herein is an image of a 
business card. 

Input part 110 receives an input image having a size of N x M pixels. As 
1 5 discussed above, it is assumed herein that the image has a size of 640 (N) x 480 
(M) pixels. The input image can be a color image or grayscale image having no 
color information. In the fourth embodiment of the present invention, it is 
assumed that the image is a grayscale image. The input image is divided into 
blocks and then classified into character blocks and background blocks by the 
20 block classification part 120. 

FIG. 6 is a block diagram illustrating a detailed structure of the block 
classification part 120 according to an embodiment of the present invention. The 
block classification part 120 performs the operation of dividing the input image 
25 into blocks having a predetermined size, and classifying the divided blocks into 
character blocks and background blocks. The block classification part 120 
classifies the divided blocks into character blocks and background blocks in 
order to optionally perform binarization on a region where characters are 
included. 
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Referring to FIG. 6, image division part 211 divides the image into 
blocks having a predetermined size. Here, the image consists of 640 x 480 pixels, 
and each of the blocks consists of 8 x 8 pixels. In this case, the image division 
5 part 211 divides the image into 4800 blocks. 

The blocks output from the image division part 211 are applied to a 
discrete cosine transform (DCT) conversion part 213, and the DCT conversion 
part 213 performs a DCT conversion on the blocks. An energy calculation part 

10 215 calculates a sum of absolute values of dominant DCT coefficients within the 
DCT-converted blocks. In this case, an energy distribution value of the DCT 
coefficients within the character blocks is larger than that of DCT coefficients 
within the background blocks. FIG. 7A is a diagram illustrating a comparison of 
energy distributions of DCT coefficients for the character blocks and the 

15 background blocks. In FIG. 7 A, the Y axis represents an average of the absolute 
sums in a log scale, and the X axis represents a zigzag scan order of the DCT 
coefficients. As illustrated in FIG. 7 A, it can be noted that DCT coefficients of 
the character blocks are larger in their average values than the DCT coefficients 
of the background blocks. FIG. 7B is a diagram illustrating an energy distribution 

20 characteristic of DCT coefficients for the character blocks. In FIG. 7B, a Y axis 
represents an average of the absolute sums in a long normal scale, and an X axis 
represents a zigzag scan order of the DCT coefficients. As illustrated in FIG. 7B, 
it can be noted that the average of absolute sums of some DCT coefficients for 
the character blocks is relatively larger. Thus, in the fourth embodiment of the 

25 present invention, it is assumed that the dominant DCT coefficients used in a 
block classification process are D] ~ D 9 shown in FIG. 7C. Accordingly, a sum of 
the absolute values of the dominant DCT coefficients in a k th block can be 
calculated by 



- 19- 



S k =t\D*\ (1) 

1=1 

In Equation (1), |Z),*| denotes an i th dominant DCT coefficient of the k th 

block, and S k denotes the sum of the absolute values of the dominant DCT 
5 coefficients in the k th block. Thus, in the various embodiments of the present 
invention, a sum of the dominant DCT coefficients D! ~ D 9 is calculated. 

The energy calculation part 215 performs the calculation of Equation (1) 
on all blocks (at k - 0, 1, 2, ... , 4799). Energy values S k (k - 0, 1, 2, ... , 4799) 
10 calculated block by block are applied to a threshold calculation part 217. 

The threshold calculation part 217 sums up the energy values S k (k = 0, 
1, 2, ... , 4799) calculated block by block, and produces an average <5*> by 
dividing the summed energy value by the total number (TBN) of blocks. The 
15 average value (S k ) is produced in accordance with Equation (2) below. The 
average value (S k ) becomes a threshold Cth used for determining the blocks as 
character blocks or background blocks. 



1 TBN 

TBN tf (2) 



= Cth 

20 

In Equation (2), TBN denotes the total number of blocks. 



Classification part 219 sequentially receives energy values 
(corresponding to sums of the absolute values of dominant DCT coefficients for 
25 the blocks) output from the energy calculation part 215 on a block-by-block 
basis. Classification part 219 classifies a corresponding block as a character 
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block or a background block by comparing the received block energy values with 
a threshold Cth. Classification part 219 classifies the k th block as a character 
block if S k > Cth and classifies the k th block as a background block if S k < Cth , 
as shown in Equation (3) below. 

5 

IF S k > Cth then CB 
elseBB 

Pixels in the character blocks classified by the classification part 120 can 
have gray levels between 0 and 255. The character blocks output from the block 
10 classification part 120 can be input to the edge enhancement part 120 (first 
embodiment of the present invention), the block growing part (second and fourth 
embodiments of the present invention), and the block grouping part (third 
embodiment of the present invention). Herein, it will be assumed that the 
character blocks are input to the block growing part 160. 

15 

The block growing part 160 grows a region of the classified character 
block. In the block classification process, a block containing character pixels may 
be incorrectly classified as a background block due to the influence of the 
background between character pixels. The block growing part 160 grows a 
20 character block in order to change a background block containing character 
pixels to a character block by extending the character block. 

The block growing part 160 can be implemented using a morphological 
filter. The morphological filter grows a character block through an erosion 
25 operation subsequent to a dilation operation for the character block called a 
closing operation. The closing operation serves to fill an internal hole of a region. 
In the closing operation, the character block is first extended through the dilation 
operation, background blocks isolated between the character blocks are converted 
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into the character blocks, and then an original block size is recovered through the 
erosion in accordance with the closing operation. The morphological filter is 
disclosed in a reference entitled "Digital Image Processing/' by R. C. Gonzalez, 
R. Woods, et al., 2 nd ed., Prentice Hall, pp. 519-560, 2002, the entire contents of 
5 which are incorporated herein by reference. The block growing part 160 changes 
a background block containing character pixels to a character block in the block 
growing process. 

The character blocks output from the block growing part 160 can be 
10 input to the block grouping part 170 (fourth embodiment of the present 
invention) or the edge enhancement part 130 (second and third embodiments of 
the present invention). Herein, it will be assumed that the character blocks are 
input to the block grouping part 1 70. 

15 Block grouping part 170 groups each of the character blocks output from 

the block classification part 120 or the block growing part 160 along with its 8 
neighboring blocks, thereby generating grouped blocks in which each consisting 
of 24 x 24 pixels. A character block consists of 8 x 8 pixels. If a threshold is 
determined to discriminate background and character pixels using only one 

20 character block for the binarization process, discontinuity between blocks of the 
binarized image can occur as the difference between the determined threshold of 
the one character block being small in size and a threshold of neighboring 
character blocks is very large. Thus, as a region is extended so that the grouped 
blocks are generated and binarized, the reliability of the binarization can be 

25 enhanced. 

The grouped block containing a character block output from the block 
grouping part 170 is applied to the edge enhancement part 130. The edge 
enhancement part 130 can receive character blocks output from the block 
30 classification part 120, the block growing part 160, or the block grouping part 
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170. Here, the character blocks output from the block classification part 120 and 
the block growing part 160 are blocks having a size of 8x8 pixels, while in the 
case of the grouped block output from the block grouping part 170 (blocks made 
by grouping character blocks to be binarized with their 8 neighboring blocks), the 
5 grouped block has a size of 24x24 pixels. 

Edge enhancement part 130 can include a quadratic filter (QF) or an 
improved quadratic filter (IQF). As shown in FIG 8, the quadratic filter 
normalizes a character block, enhances edges of the normalized character block, 

10 denormalizes the edge-enhanced character block to convert the character block in 
the range of a brightness value before normalization, and generates, from the 
denormalized character blocks, a threshold BTH used for binarizing pixels of the 
character blocks. As shown in FIG. 10, the improved quadratic filter normalizes a 
character block, enhances edges of the normalized character block, normalizes a 

15 threshold calculated from the character block, and generates a threshold BTH N 
for binarizing pixels in the character block. 

Operation of enhancing the edges of a character block using the 
quadratic filter will be now described with reference to FIG 8. 

20 

Referring to FIG. 8, a first threshold selection part 311 calculates the first 
threshold Thl for classifying pixels of the character block into character pixels 
and background pixels. The first threshold selection part 311 calculates the first 
threshold Thl that is used for discriminating character and background pixels and 
25 normalizing two types of the discriminated pixels. The first threshold Thl is 
selected as a gray value corresponding to the maximum between-class variance 
between the two types of discriminated pixels. The first threshold Thl can be 
calculated using Otsu's method or Kapur's method. Otsu's method for 
calculating the first threshold Thl is based on Equation (4) below. The method 
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made by N. Otsu is disclosed in a paper entitled "A Threshold Selection Method 
from Gray-Level Histograms," IEEE Trans. Systems, Man and Cybernetics, Vol. 
SMC-9, No. 1, pp. 62-66, Jan. 1979, the entire contents of which are incorporated 
herein by reference. 



5 



Th x - arg max a B (T) 

T 

<y\ (D = /> (//, (T) - nf + P 2 (TXju 2 (T) - M f 

= P 1 (T)P 2 (T)(MT)-MT)) 2 

a\ (T) : between - class variance (4) 

T : gray value 

fi : mean of the total pixels 

f~ii(T) : mean of each class defined by T 

P;(T) : relative frequency of each class 

A mean computation part 313 classifies pixels of the character block into 
character and background pixels on the basis of the first threshold Thl, and 

10 calculates mean brightness values for the character and background pixels for a 
character block. In the process of mean computation for two classes, pixels of the 
character block x(m, n) are classified into character pixels (CPs) and background 
pixels (BPs) on the basis of the first threshold Thl in accordance with Equation 
(5) below, and then a mean brightness value // 0 for the character pixels and a 

15 mean brightness value ju x for the background pixels is calculated in accordance 
with Equation (6) below. 



If x(m,n)>Thl then CP 

7 7 (5) 

else BP v J 



20 In Equation (5), x(m,n) denotes a character block, and Thl denotes a 

threshold for classifying the pixels of the character block into character and 
background pixels. 
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In Equation (6), S c denotes the sum of brightness values for the character 
5 pixels, N c denotes the number of character pixels, S b denotes a sum of 
brightness values for the background pixels, and N b denotes the number of 
background pixels. 

A normalization part 315 normalizes the pixels of the character block 
10 x(m,ri) using the mean brightness value ju 0 for the character pixels, and the mean 
brightness value ju } for the background pixels from the mean computation part 
313 so that the character pixels have values close to T while the background 
pixels have values close to c 0\ The normalization part 315 performs a function of 
reducing a dynamic range of the brightness values for the input character block 
15 pixels by normalizing the pixels of the character block x(m y n) in accordance 
with Equation (7) below. 

x N (m, n) = — ^ J (7) 

(Mo -Mi) 

20 In Equation (7), x N (m,ri) denotes a normalized character block, /u 0 

denotes a mean brightness value for the character pixels, and //, denotes a mean 
brightness value for the background pixels. 

The normalized character block x N (m 9 n) is subject to a quadratic 
25 operation in a quadratic operation part 317, so that edges of the character block 
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are enhanced and their noise components are reduced. The quadratic operation 
part 317 performs the function of enhancing edges using relations between the 
normalized pixels and their surrounding pixels, and reducing the noise 
components. FIG 9 shows a central pixel and its surrounding pixels processed by 
5 the quadratic operation part 317. Equation (8) below has functional 
characteristics capable of enhancing the edges and reducing the noise 
components when the quadratic operation part 317 performs a quadratic 
operation. The quadratic operation part 317 "darkly" processes the character 
pixels and "brightly" processes the background pixels on the basis of a large gray 
10 level difference, such that character edges are processed clearly and 
simultaneously their noise components are removed. 



y Q = 



K x o + K Z *2/-i + K Z x 2g + h 3 x 0 2 + h 4 £ x 2 2i _ x + h 5 ]T x 2 2i 



1=1 1=1 



V 



+ 



( 4 4 A ( 4 4 *\ 

K X *0*2/-, + h l S X 0 X 2i + K Z X 2i-l X 2 r-l + k 9 Z X 2/-l (^2i + ^ 2l « ) 
V /=! 1=1 J V i=\ /=1 

where i * = (i + 1) mod 4 !** = (/ + 3) mod 4 



(8) 



15 The output of the quadratic operation part 317 is input to the 

denormalization part 319, and the denormalization part 319 generates an output 
y(m,n) by denormalizing the quadratic-processed character block y N (m,n). The 
denormalization part 319 performs the function of converting pixels of the 
normalized character block in the range of a brightness value before 

20 normalization. The denormalization part 319 performs the denormalization 
operation in accordance with Equation (9) below. 

y(m, n) = y N (w, «)(// 0 + (9) 

25 The character block y(m,n) output from the denormalization block 319 is 

applied to the binarization part 140 and the second threshold selection part 321. 
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The second threshold selection part 321 calculates a second threshold Th2 used 
when the binarization part 140 binarizes pixels of the character block into 
character pixels and background pixels. The second threshold Th2 corresponds to 
a threshold BTH of the binarization part 140. The second threshold selection part 
5 321 is used because the denormalization part 319 denormalized the normalized 
character block back into a character block having its original brightness. The 
second threshold selection part 321 can calculate the threshold BTH (or second 
threshold Th2) using Otsu's method or Kapur's method. When Otsu's method is 
used, the second threshold selection part 321 calculates the threshold BTH by 
10 calculating pixels of the denormalized character block in accordance with 
Equation (4). 

The edge enhancement part 130 shown in FIG. 8 reduces the dynamic 
range between light and dark pixels by normalizing the character and background 

15 pixels within a character block (or a grouped block containing the character 
block), performs a quadratic operation on the normalized pixels to enhance the 
edges of the character block (or the grouped block containing the character 
block), and denormalizing the normalized pixels of the normalized character 
block (or the grouped block containing the character block) in the original gray 

20 level range of the pixels. From the pixels of the denormalized character block, 
the edge enhancement part 130 calculates again a threshold for binarizing pixels 
of the character block. 

It is also possible to enhance the edges of a character block (or a grouped 
25 block containing the character block) using the improved quadratic filter shown 
in FIG. 10, which is an improvement of the quadratic filter of FIG. 8. FIG. 10 is a 
block diagram illustrating the structure of the edge enhancement part 130 using 
the improved quadratic filter. 

30 Referring to FIG. 10, a first threshold selection part 311 calculates the 
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first threshold Thl for classifying pixels of the character block into character 
pixels and background pixels. The first threshold selection part 3 1 1 is identical in 
operation to the first threshold selection part 311 of FIG. 8. 

Mean computation part 313 classifies pixels of the character block into 
character and background pixels on the basis of the first threshold Thl, and 
calculates mean brightness values for the character and background pixels for a 
character block. The mean computation part 313 is identical in operation to the 
mean computation part 313 of FIG. 8. 

Normalization part 315 normalizes the pixels of the character block 
x{m,n) using the mean brightness value ju 0 for the character pixels and the mean 
brightness value ju x for the background pixels from the mean computation part 
313, so that the character pixels have values close to T while the background 
pixels have values close to '0\ The normalization part 315 is identical in 
operation to the normalization part 315 of FIG. 8. 

Quadratic operation part 317 performs the function of enhancing edges 
using relations between the normalized pixels and their surrounding pixels, and 
20 reducing the noise components. FIG. 9 shows a central pixel and its surrounding 
pixels processed by the quadratic operation part 317. Equation (8) has functional 
characteristics capable of enhancing the edges and reducing the noise 
components when the quadratic operation part 317 performs a quadratic 
operation. The quadratic operation part 317 is identical in operation to the 
25 quadratic operation part 3 1 7 of FIG. 8. 

The normalized character block (or a grouped block containing the 
character block) output from the quadratic operation part 3 1 7 is output without 
undergoing denormalization. Thus, in order to generate the threshold BTH N used 
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by the binarization part 140 in binarizing pixels of the character block, a 
threshold normalization part 331 in the improved quadratic filter generates the 
second threshold Th2 by normalizing the first threshold Thl calculated by the 
first threshold selection part 311. The second threshold Th2 is used as the 
5 threshold BTH N for the binarization operation for the character block pixels by 
the binarization part 140. 

Threshold normalization part 331 normalizes the first threshold Thl 
using a method equal to the normalization method of the normalization part 315. 
10 The threshold normalization part 331 normalizes the first threshold Thl in 
accordance with Equation (10) below, to generate the second threshold Th2 (or 
the threshold BTH N ). 



n2= Vhl-K) (1Q) 

(Mo -Mi) 



15 



In Equation (10), Thl denotes a normalized threshold BTH N for allowing 
the binarization part 140 to discriminate the character and background pixels, ju 0 
denotes a brightness value for the character pixels, and ju x denotes a mean 
brightness value for the background pixels. 

20 

The edge enhancement part 130 shown in FIG. 10 reduces the dynamic 
range by normalizing the character and background pixels within a character 
block (or a grouped block containing the character block), and performs a 
quadratic operation on the normalized pixels to enhance the edges of the 
25 character block (or the grouped block containing the character block (CB)). Since 
the character block (or the grouped block containing the CB) output from the 
quadratic operation part 317 is a normalized block, the threshold BTH N for the 
binarization of the character block pixels is generated by normalizing the first 
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threshold Thl. 

As described above, in the first to fourth embodiments of the present 
invention, the edge enhancement part 130 can be implemented using the 
5 quadratic filter of FIG. 8 or the improved quadratic filter of FIG 10. The edge 
enhancement part 130 using the improved quadratic filter performs the function 
of enhancing edges while solving the drawback of a black block surrounding 
characters of the binarized image that occurs after the character block (or the 
grouped block containing the character block) is binarized. When the improved 

10 quadratic filter is used, the denormalization operation used in the quadratic filter 
is not performed. Therefore, when the quadratic filter is used, the edge 
enhancement part 130 denormalizes the quadratic-processed character block (or a 
grouped block containing the character block), and at the same time, calculates a 
threshold BTH from the denormalized character block (or the grouped block 

15 containing the character block). When the improved quadratic filter is used, 
however, the edge enhancement part 130 uses the intact quadratic-processed 
normalized character block (or the grouped block containing the character block), 
and calculates the threshold BTH N by normalizing the first threshold Thl. FIGs. 
11 A to 11C are diagrams for making a comparison of output characteristics 

20 between the quadratic filter (QF) and the improved quadratic filter (IQF). 
Specifically, FIG. 11A illustrates an image input to the filter, FIG. 11B illustrates 
an image after quadratic filtering, and FIG. 11C illustrates an image after 
improved quadratic filtering. 

25 When a character block is output from the edge enhancement part 130, 

the character block is applied to the binarization part 140, and when a grouped 
block containing a character block is output from the edge enhancement part 130, 
the grouped block is applied to the block splitting part 1 80. The block splitting 
part 180 receiving the grouped block containing a character block separates the 

30 character blocks from the grouped block. Separation of the character blocks from 
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the grouped block is performed for image restoration after the surrounding blocks 
associated with the character block are grouped by the block grouping part 170. 
The block splitting part 180 separates the 8x8 center block from the 24x24 
grouped block. 

5 

The character blocks output from the block splitting part 1 80 or the edge 
enhancement part 130 are input to the binarization part 140. The binarization part 
140 receives the threshold output from the edge enhancement part 130 to binarize 
the pixels in the character blocks. The character blocks input into the binarization 
10 part 140 are y(m,ri) (corresponding to character blocks output from the quadratic 
filter of FIG. 8) or y N {m,n) (corresponding to character blocks output from the 

improved quadratic filter of FIG. 10). Thus, the threshold becomes BTH or 
BTH N . 

15 Binarization part 140 performs the binarization operation by classifying 

the received character block pixels into the character and background pixels 
using the threshold, and converting the classified character and background 
pixels into the two brightness values. The binarization part 140 compares the 
threshold corresponding to the input character block with values of the character 

20 block pixels, classifies the pixels as character pixels if the values of the character 
block pixels are equal to or larger than the threshold as a result of the 
comparison, and classifies the pixels as background pixels if the values of the 
character block pixels are smaller than the threshold. Binarization part 140 
performs the binarization operation by converting the character pixels into a 

25 brightness value "<z" and converts the background pixels into a brightness value 
"/?" according to the result of classifications. A method for binarizing character 
block pixels by means of the binarization part 140 is defined as 
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, , [<*, if y(m,n)>BTHorif y N (m,n)>BTH N 

y B (™>n) = ] R . (11) 

[ p, otherwise 



In Equation (11), y(jn 9 ri) and 577/ denote a character block and a 
threshold output from the quadratic filter, respectively, y N (m 9 ri) and BTH N 
5 denote a character block and a threshold output from the improved quadratic 
filter, respectively, and y B (m 9 ri) denotes pixels of the binarized character block. 



Binarization part 140 receives a background block from the block 
classification part 120 or the block growing part 160, and collectively converts 
1 0 the background block pixels into the brightness value " J3 



FIGs. 12 to 15 are flowcharts illustrating binarization procedures 
according to first to fourth embodiments of the present invention, respectively. 

15 The binarization operation according to the first embodiment of the 

present invention will now be described with reference to FIG. 12. In step 411 it 
is determined whether an image has been received. If an image has been received 
("Yes" path from decision step 411), the procedure proceeds to step 413. In step 
413, the received image is divided into blocks having a predetermined size, and 

20 the divided blocks are classified into character blocks and background blocks. 



FIG. 16 is a flowchart illustrating the procedure for dividing an input 
image into blocks and classifying divided blocks into character blocks and 
background blocks according to an embodiment of the present invention. FIG. 16 
25 represents the operations performed in element 413 of FIGS. 12-15. Referring to 
FIG. 16, in step 611, the image division part 211 divides an input image into 
blocks having a predetermined size. The image consists of 640 x 480 pixels, and 
each of the blocks consists of 8 x 8 pixels. In this case, the input image is divided 
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into 4800 blocks. 

Thereafter, a block number BN is set to 0 in step 613, and a block with 
the block number BN is accessed in step 615. In step 617, the DCT conversion 
5 part 213 DCT-con verts the accessed block. In step 619, the energy calculation 
part 215 calculates the sum S k of absolute values of dominant DCT coefficients 
within the DCT-converted block, and then stores the calculated sum S k . In this 
case, an energy distribution value of the DCT coefficients within the character 
blocks is larger than that of DCT coefficients within the background blocks. 

10 Energy distributions of the DCT coefficients for the character blocks and the 
background blocks show a characteristic illustrated in FIG. 7A. In addition, the 
energy distribution characteristic of DCT coefficients for the character blocks 
shows the characteristic illustrated in FIG. 7B. Therefore, the sum S k of absolute 
values of the DCT coefficients in the k th block can be calculated in accordance 

15 with Equation (1). Here, c k' is the same parameter as BN, and denotes a block 
number. After the S k is calculated in step 619, it is determined in step 621 
whether S k of the last block is calculated. If S k of the last block is not calculated 
yet ("No" path from decision step 621), the procedure increases the block 
number by one in step 623, and then returns to step 615 to repeat the above 

20 operation (steps 615 through 621). 

Through repetition of the steps 615 to 623, DCT conversion part 213 
DCT-converts the respective blocks and the energy calculation part 215 performs 
the calculation of Equation (1) on all blocks (at k = 0, 1, 2, ... , 4799). In step 
25 625("Yes" path from decision step 621), the block energy values S k (k = 0, 1, 2, 
... , 4799) are applied to the threshold calculation part 217, and the threshold 
calculation part 217 sums the energy values S k (k = 0, 1, 2, ... , 4799), and 
calculates an average <S k > by dividing the summed energy value by the total 
number TBN of blocks. The average value (S k ) is produced in accordance with 
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Equation (2). The average value (S k ) becomes a threshold Cth used for 
determining the blocks as character blocks or background blocks. 

After the threshold Cth is calculated, the operation of classifying the 
5 blocks into character blocks and background blocks is performed. For that 
purpose, a block number BN is initialized to '0' in step 627, and S k of a block 
with the block number BN is accessed in step 629. Thereafter, in step 631, the 
classification part 219 classifies the corresponding block as a character block or a 
background block by comparing S k of the block with the threshold Cth . 

10 Classification part 219 classifies, in step 633, the k th block as a character block 
(CB) if S k > Cth ("Yes" path from decision step 631) and classifies in step 635 
the k th block as a background block if S k < Cth as shown in Equation (3) ("No" 
path from decision step 631). Thereafter, it is determined in step 637 whether the 
classified block is the last block. If the block #BN is not the last block("No" path 

15 from decision step 637), the procedure increases the block number by one in step 
639, and then returns to step 629 to repeat the above operation. When the above 
operation is completely performed, the block classification results are output. 
After the image is divided into the blocks, the divided blocks are classified into 
character blocks and background blocks. 

20 

Referring back to FIG. 12, after the block classification is completed, a 
block number BN is initialized to 6 0' in step 415, and a block #BN is accessed in 
step 417. It is then determined, in step 419, whether the accessed block #BN is a 
character block. If the accessed block is a background block ("Yes" path from 
25 decision step 419), the procedure proceeds to step 423 where pixels of the 
background block are collectively binarized into a brightness value p. The 
binarized result is stored in step 425. It is then determined, in step 427, whether 
the currently binarized block is the last block of the image. If the binarized block 
is not the last block ("No" path from decision step 427), the procedure increases 
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the block number BN by one in step 429, and then returns to step 417 to repeat 
the above operation (steps 417 - 427). 

However, if it is determined in step 419 that the access block is a 
5 character block ("No" path from decision step 419), the procedure proceeds to 
step 42 1 where a quadratic filtering operation for reducing noises of the character 
block and enhancing edges of the character block is performed. The procedure 
for reducing noise of the character block and enhancing edges of the character 
block is performed by the quadratic filter of FIG. 8 or the improved quadratic 
10 filter of FIG. 10. 

The operation of enhancing edges of a character block using the 
quadratic filter of FIG. 8 will now be described. 

15 First, the first threshold Thl for classifying pixels of the character block 

into character pixels and background pixels is calculated. The first threshold Thl 
is used for discriminating character and background pixels and normalizing two 
types of the discriminated pixels in the next step. The first threshold Thl is 
selected as a gray value corresponding to the maximum between-class variance 

20 between the two types of discriminated pixels in accordance with Equation (4). 

Second, pixels of the character block are classified into character and 
background pixels on the basis of the first threshold Thl, and mean brightness 
values for the character and background pixels for a character block are 
25 calculated. In the process of mean computation for two classes, pixels of the 
character block x(m,n) are classified into character pixels and background pixels 
on the basis of the first threshold Thl in accordance with Equation (5), and then a 
mean brightness value ju 0 for the character pixels and a mean brightness value ju } 
for the background pixels are calculated in accordance with Equation (6). 
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Third, the pixels of the character block x(m,n) are normalized using the 
mean brightness value ju 0 for the character pixels and the mean brightness value 
H x for the background pixels from the mean computation part 313 so that the 
5 character pixels have values close to ' V while the background pixels have values 
close to c 0\ The character block normalization method normalizes the pixels of 
the character block x(m,n) in accordance with Equation (7). 

Fourth, the normalized character block x N (m,n) is subject to the 
10 quadratic operation, so that the edges of the character block are enhanced and 
their noise components are reduced. In the quadratic operation process, the 
character pixels are "darkly" processed and the background pixels are "brightly" 
processed on the basis of a large gray level difference, such that the character 
edges are processed clearly, and their noise components are simultaneously 
15 removed. Such an operation is performed in accordance with Equation (8). 

Fifth, an output y(m,n) is generated by denormalizing the quadratic- 
processed character block y N (m,n). The denormalization process performs a 
function of converting pixels of the normalized character block in the range of a 
20 brightness value before normalization. The denormalization operation is 
performed in accordance with Equation (9). 

Sixth, the second threshold Th2 is calculated using the character block 
y(m,n) generated in the denormalization process. The second threshold Th2 
25 corresponds to a threshold BTH for binarizing pixels of the character block into 
character pixels and background pixels. The second threshold Th2 can be 
calculated using Otsu's method or Kapur's method. When Otsu's method is used, 
the second threshold Th2 (or the threshold BTH) is determined by calculating 
pixels of the denormalized character block in accordance with Equation (4). 
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The operation of enhancing the edges of a character block using the 
improved quadratic filter of FIG. 10 will now be described. 

5 First, the first threshold Thl for classifying pixels of the character block 

into character pixels and background pixels is calculated. The first threshold 
calculation method is identical to the first threshold calculation method of FIG. 8. 

Second, pixels of the character block are classified into character and 
10 background pixels on the basis of the first threshold Thl, and then mean 
brightness values for the character and background pixels for a character block 
are calculated. The mean brightness value calculation method is identical to the 
mean brightness value calculation method of FIG. 8. 

15 Third, the pixels of the character block x(m,n) are normalized using the 

mean brightness value ju 0 for the character pixels and the mean brightness value 
//, for the background pixels so that the character pixels have values close to ' V 
while the background pixels have values close to '0\ The normalization method 
is also identical to the normalization method of FIG. 8. 

20 

Fourth, by performing a quadratic operation using relations between the 
normalized pixels and their surrounding pixels, edges of the character block are 
enhanced and the noise components of the character block are reduced. The 
quadratic operation is also identical to the quadratic operation of FIG. 8. 

25 

Fifth, the second threshold Th2 is calculated by normalizing the first 
threshold Thl. This is because the normalized character block is delivered to the 
binarization part without denormalization of the quadratic-processed character 
block. If the improved quadratic filtering of FIG. 10 is used, the second threshold 

s 
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Th2 is calculated by normalizing the first threshold Thl in accordance with 
Equation (10). 

As described above, in the embodiments of the present invention, the 
5 quadratic filter of FIG 8 or the improved quadratic filter of FIG. 10 can be used 
to enhance edges of a character block. The improved quadratic filter performs the 
function of enhancing edges, while solving the drawback of a black block 
surrounding characters of the binarized image that occurs after the character 
block is binarized using the quadratic filter. When the improved quadratic filter is 

10 used, the denormalization operation used in the quadratic filter is not performed. 
Therefore, when the quadratic filter is used, the quadratic-processed character 
block is denormalized, and at the same time, a threshold BTH is calculated from 
the denormalized character block. However, when the improved quadratic filter 
is used, the intact quadratic-processed normalized character block is used, and 

1 5 the threshold BTH N is calculated by normalizing the first threshold Thl . 

After noise of the character block is reduced and the edges of the 
character block are enhanced using the quadratic filter or the improved quadratic 
filter in step 42 1 , a binarization operation is performed in step 423 by comparing 

20 pixels of the character blocks with the threshold BTH or BHT N . In the 
binarization process, if the pixel values are smaller than the threshold BTH or 
BTH N , the corresponding pixels are converted into the brightness value (3 for 
background pixels, and if the pixel values are larger than the threshold BTH or 
BTH N , the corresponding pixels are converted into the brightness value a for 

25 character pixels. Brightness values of character block pixels are compared with 
the threshold BTH, and binarized into brightness value for character pixels or 
brightness value for background blocks. The binarized results are stored in step 
425. If it is determined, however, in step 419, that the accessed block is a 
background block ("No" path from decision step 419) , the edge enhancement 
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operation is not performed and the pixels of the background block are 
collectively binarized into the brightness value for background pixels in step 423. 

FIG. 17 is a flowchart illustrating the binarization operation, 413, used in FIGS. 
5 12-15. Referring to FIG. 17, the binarization part 140 determines in step 711 
whether a received block is a character block or a background block. If the 
received block is a character block ("No" path from decision step 711), the 
binarization part 140 initializes a pixel number PN to '0' in step 713, and then 
accesses a pixel #PN in step 715. The pixel of the character block is quadratic- 

10 processed pixel by the quadratic filter of FIG. 8 or the improved quadratic filter 
of FIG 10. Thereafter, in step 717, the binarization part 140 compares a value of 
the accessed pixel with the threshold in accordance with Equation (11). If the 
brightness value of the accessed pixel is larger than or equal to the threshold 
("Yes" path from decision step 717), the corresponding pixel is converted into a 

15 brightness value a for character pixels in step 721, and if the brightness value of 
the accessed pixel is smaller than the threshold ("No" path from decision step 
717), the corresponding pixel is converted into a brightness value (5 for 
background pixels in step 719. Thereafter, the binarization part 140 determines in 
step 723 whether the binarization process is completed for all pixels of the 

20 corresponding character block. If the binarization process is not completed ("No" 
path from decision step 723), the binarization part 140 increases the pixel number 
PN by one in step 729, and then returns to step 715 to repeat the above 
binarization operation. Throughout this binarization process, all pixels of the 
character block are binarized into a brightness value a or a brightness value (5. 

25 However, if it is determined in step 711 that the received block is a background 
block ("Yes" path from decision step 711), the binarization part 140 performs 
steps 731 to 739 in which all pixels of the background block are collectively 
converted into the brightness value p for background pixels. 
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Referring back now to FIG. 12, After the binarization operation is 
performed, it is determined in step 427 whether the currently binarized block is 
the last block of the image. If the current block is not the last block ("No" path 
from decision step 427), the procedure increase the block number BN by one in 
5 step 429, and then returns to step 417 to repeat the above operation (step 417 
through step 427 . Through repetition of the above operation, the character blocks 
and the background blocks of the image are binarized. In the meantime, if it is 
determined in step 427 that binarization on the last block of the image is 
completed, the binarized results of the image are provided to the binarization part 
10 140 in step 431. 

A binarization operation according to the second embodiment of the 
present invention will now be described with reference to FIG. 13. In the second 
embodiment, blocks of an input image are classified into character blocks and 

15 background blocks in step 413, and then the character blocks are grown in step 
511. The block classification process is performed as discussed above in 
reference to FIG. 16. In the block classification process, a block containing 
character pixels can be incorrectly classified as a background block due to the 
influence of a background between character pixels. Therefore, in the block 

20 growing process of step 511, the character blocks are grown so that a character 
pixel can be included in a character block. 

Block growing is aimed at changing a background block containing 
character pixels to a character block by extending the character block. Block 

25 growing can be implemented using a morphological filter. The morphological 
filter grows a character block through an erosion operation subsequent to a 
dilation operation for the character block called a closing operation. The closing 
operation serves to fill an internal hole of a region. The character block is 
extended through the dilation operation, background blocks isolated between the 

30 character blocks are converted into the character blocks, and an original block 
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size is recovered through the erosion in accordance with the closing operation. 
The other operations are equal to those in the first embodiment of FIG. 12. 

A binarization operation according to the third embodiment of the 
5 present invention will now be described with reference to FIG. 14. If it is 
determined in step 411 that an image is received ("Yes" path from decision step 
411), the received image is divided into blocks having a predetermined size and 
then classified into character blocks and background blocks in step 413. The 
block classification process is performed as discussed above in reference to FIG. 
10 16. A binarization process on the character blocks includes the edge enhancement 
process of FIG. 8 or 10, and the binarization process of FIG. 17. 

If a threshold is determined to discriminate background and character 
pixels using only one character block (consisting of 8x8 pixels) for the 

15 binarization process, discontinuity between blocks of the binarized image can 
occur as a difference between the determined threshold of the one character block 
being small in size and a threshold of neighboring character blocks is very large. 
Therefore, in step 521, each of the classified character blocks is grouped with its 
8 neighboring blocks, thereby generating grouped block having a size of 24x24 

20 pixels. After the character blocks to be binarized are grouped with their 
neighboring blocks in the block grouping process, pixels of the extended blocks 
are subject to quadratic filtering in step 421. Thereafter, in step 523, a central 
character block having a size of 8x8 pixels is separated from the quadratic- 
filtered or improved quadratic-filtered grouped block. In steps 423 to 429, pixels 

25 of the separated character block are binarized based on the threshold BTH or 
BTH N . The other operations are equal to those in the first embodiment of FIG. 12. 

A binarization operation according to the fourth embodiment of the 
present invention will now be described with reference to FIG. 15. In the fourth 
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embodiment, blocks of an input image are classified into character blocks and 
background blocks in step 413, and then the character blocks are grown in step 
511. In the block classification process, a block containing character pixels can 
be incorrectly classified as a background block due to the influence of a 
5 background between character pixels. Therefore, in the block growing process of 
step 511, the character blocks are grown so that a character pixel can be included 
in a character block. 

Thereafter, a binarization process is performed on the character blocks 
10 and the background blocks according to the block classification result. If an 
accessed block is a character block, the character block is grouped in step 521 
with its 8 neighboring blocks, thereby generating grouped block having a size of 
24x24 pixels. If binarization is performed using only one character block 
(consisting of 8x8 pixels), the binarization can be affected by the noises in the 
15 character block as it is too small in size. Therefore, a character block to be 
binarized is grouped with its 8 neighboring blocks to extend its region in the 
block grouping process, and then, in step 421, pixels in the extended block are 
subject to quadratic filtering or improved quadratic filtering. Thereafter, in step 
523, a central character block having a size of 8x8 pixels is separated from the 
20 quadratic-filtered or improved quadratic-filtered grouped block. In steps 423 to 
429, pixels of the separated character block are binarized based on the threshold 
BTH or BTH N . The other operations are equal to those in the first embodiment of 
FIG. 12. 

25 FIG. 18 is a flowchart illustrating an example of a binarization method in 

which the edge enhancement part 130 is implemented using the quadratic filter in 
accordance with an embodiment of the present invention. FIG. 18 shows a 
binarization method according to the fourth embodiment of the present invention 
in which the quadratic filter is used. FIGs. 19A to 191 are diagrams illustrating 
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images generated when the binarization is performed in the procedure of FIG. 18. 



Referring to FIG 18, in step 611, the input part 110 receives an input 
image shown in FIG 19 A. It is assumed that the image consists of 640 (columns) 
5 x 480 (rows) pixels. In step 613, the block classification part 120 divides the 
input image of FIG. 19A received from the input part 110 into blocks, analyzes 
pixels of the divided blocks, and classifies the divided blocks into character 
blocks and background blocks. The input image is divided into 8x8-pixel blocks, 
and then classified into character blocks and background blocks shown in FIG 
10 19B. In FIG. 19B, gray portions represent regions classified as character blocks, 
while black portions represent regions classified as background blocks. 

In step 615, the block growing part 160 extends the character blocks 
classified by the block classification part 120 as shown in FIG 19C. In the block 

15 classification process, a block containing character pixels can be incorrectly 
classified as a background block due to the influence of a background between 
character pixels. The block growing part 160 grows the character blocks in order 
to extend pixels in a character block incorrectly classified as a background block. 
Then, in step 617, the block growing part 160 sequentially outputs grown 

20 character blocks of FIG 19C to the block grouping part 170. The image output to 
the block grouping part 1 70 corresponds to the character blocks shown in FIG 
19D. In step 619, the block grouping part 170 receives the character blocks of 
FIG 19D output from the block growing part 160, and groups each of the 
character blocks with its 8 adjacent blocks, generating the grouped blocks of FIG. 

25 19E. 

The grouped block image of FIG 19E is input into the edge enhancement 
part 130. The edge enhancement part 130 is the quadratic filter. In step 621, the 
quadratic filter calculates the first threshold value Thl for classifying each pixel 
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of the character block as a character or background pixel. The first threshold 
value Thl can be calculated using Equation (4). In step 623, the mean 
computation part 313 classifies pixels of the character block into character and 
background pixels on the basis of the first threshold value Thl, and calculates 
5 mean brightness values for the character and background pixels for a character 
block, in accordance with Equation (5) and Equation (6). In step 625, the 
normalization part 315 normalizes the pixels of the character block x(m,n) using 
the mean brightness value /j 0 for the character pixels and the mean brightness 
value //, for the background pixels output from the mean computation part 313 
10 so that the character pixels have values close to a ' V while the background pixels 
have values close to '0'. The normalization part 315 normalizes the pixels of the 
character block x(m,n) in accordance with Equation (7). 

In step 627, the normalized character block x N (m,ri) is subject to a 
15 quadratic operation in the quadratic operation part 317, so that edges of the 
character block are enhanced and their noise components are reduced. The 
quadratic operation part 317 performs the calculation of Equation (8). In step 
629, the denormalization part 319 denormalizes the quadratic-processed 
character block y N (m,n) and generates an output block y(m,n). The 
20 denormalization part 319 performs the function of converting pixels of the 
character block normalized by the normalization part 315 in the range of a 
brightness value before normalization in accordance with Equation (9). An image 
output from the denormalization part 319 is shown in FIG 19F, and the character 
block y(m,n) is applied to the block splitting part 1 80 and the second threshold 
25 selection part 321. In step 631, the second threshold selection part 321 generates 
a second threshold Th2 for binarizing pixels of the character block into character 
pixels and background pixels in the binarization part 140, and the second 
threshold Th2 becomes the threshold BTH of the binarization part 140. 
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In step 633, the block splitting part 180 receives the edge- enhanced 
grouped block of FIG. 19F output from the quadratic filter, and separates the 
character block of FIG. 19G from the grouped block. The block splitting part 180 
performs the function of separating only the character block located at the center 
5 of the grouped block from the grouped block. In step 635, the binarization part 
140 compares pixels of the separated character block of FIG. 19G with the 
threshold BTH N , and binarizes the pixels into character and background pixels 
having the first and second brightness values as shown in FIG. 1 9H. Pixels of the 
background block output from the block classification part 120 or the block 
10 growing part 160 are binarized into the second brightness value. 

Through repetition of the above operation, the character blocks and the 
background blocks are binarized, and if it is determined in step 637 that the 
binarization is completed for all bocks of the image, a binarized image of FIG. 
15 191 is output in step 639 ("Yes" path from decision step 637). 

FIG. 20 is a flowchart illustrating an example of a binarization method in 
which the edge enhancement part 130 is implemented using the improved 
quadratic filter in accordance with an embodiment of the present invention. FIG. 
20 20 shows a binarization method according to the fourth embodiment in which the 
improved quadratic filter is used. FIGs. 21 A to 21 G are diagrams illustrating 
images generated when the binarization is performed in the procedure of FIG. 20. 

Referring to FIG. 20, in step 611, the input part 110 receives an input 
25 image shown in FIG. 21 A. It is assumed that the image consists of 640 (columns) 
x 480 (rows) pixels. In step 613, the block classification part 120 divides the 
input image of FIG. 21 A received from the input part 110 into blocks, analyzes 
pixels of the divided blocks, and classifies the divided blocks into character 
blocks and background blocks. The input image is divided into 8x 8-pixel blocks, 
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and then classified into character blocks and background blocks shown in FIG. 
2 IB. In FIG. 2 IB, gray portions represent regions classified as character blocks, 
while black portions represent regions classified as background blocks. 

5 In step 615, the block growing part 160 extends the character blocks 

classified by the block classification part 120 as shown in FIG. 21C. In the block 
classification process, a block containing character pixels can be incorrectly 
classified as a background block due to the influence of a background between 
character pixels. The block growing part 160 grows the character blocks in order 

10 to extend pixels in a character block incorrectly classified as a background block. 
Then, in step 617, the block growing part 160 sequentially outputs grown 
character blocks of FIG. 21C to the block grouping part 170. The image output to 
the block grouping part 170 corresponds to the character blocks shown in FIG. 
2 ID. In step 619, the block grouping part 170 receives the character blocks of 

15 FIG. 2 ID output from the block growing part 160, and groups each of the 
character blocks with its 8 adjacent blocks, generating the grouped blocks of FIG. 
21E. 

The grouped block image of FIG. 2 IE is input into the edge enhancement 
20 part 130. The edge enhancement part 130 is the improved quadratic filter. In step 
621, the improved quadratic filter calculates the first threshold value Thl for 
classifying each pixel of the character block as a character or background pixel. 
The first threshold value Thl can be calculated using Equation (4). In step 623, 
the mean computation part 313 classifies pixels of the character block into 
25 character and background pixels on the basis of the first threshold value Thl, and 
calculates mean brightness values for the character and background pixels for a 
character block, in accordance with Equation (5) and Equation (6). In step 625, 
the normalization part 315 normalizes the pixels of the character block x(m,ri) 
using the mean brightness value ju 0 for the character pixels and the mean 
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brightness value ju } for the background pixels output from the mean computation 
part 313 so that the character pixels have values close to a T while the 
background pixels have values close to '0\ The normalization part 315 
normalizes the pixels of the character block x(m 9 n) in accordance with Equation 
5 (7). 

In step 627, the normalized character block x N {m,n) is subject to a 
quadratic operation in the quadratic operation part 317, so that edges of the 
character block are enhanced and their noise components are reduced. The 

10 quadratic operation part 317 performs the calculation of Equation (8). In step 
711, the threshold normalization part 331 normalizes the first threshold Thl 
using a method equal to the normalization method of the normalization part 315. 
The threshold normalization part 331 normalizes the first threshold Thl in 
accordance with Equation (10), to generate the second threshold Th2 (or the 

15 threshold BTH N ). 

In step 633, the block splitting part 180 receives the grouped block 
output from the quadratic filter, and separates the character block from the 
grouped block. The block splitting part 180 performs the function of separating 

20 only a character block located at the center of the grouped block from the 
grouped block. In step 635, the binarization part 140 compares pixels of the 
character block separated by the block splitting part 180 with the threshold 
BTH N , and binarizes the pixels into character and background pixels having the 
first and second brightness values as shown in FIG. 2 IF. Pixels of the background 

25 block output from the block classification part 120 or the block growing part 160 
are binarized into the second brightness value. 

Through repetition of the above operation, the character blocks and the 
background blocks are binarized, and if it is determined in step 637 that the 
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binarization is completed for all bocks of the image, a binarized image of FIG. 
21G is output in step 639. 

As described above, the new preprocessing operation for recognizing 
5 characters from an image includes dividing the image into blocks, classifying the 
divided blocks into character blocks and background blocks, performing a 
quadratic operation only on the character blocks, binarizing the quadratic- 
processed character blocks into character pixels and background pixels, and 
collectively binarizing all pixels of the background blocks into background 

10 pixels. Therefore, even when the binarization is performed on an image 
photographed in an irregularly lighted situation, with a shadow thrown thereon, 
its binarization performance can be improved. In addition, a block containing a 
character pixel, incorrectly classified as a background block, is reclassified as a 
character block, improving reliability of block classification. Moreover, it is 

1 5 possible to improve reliability of binarization on character blocks by grouping a 
character block with its neighboring blocks, performing a quadratic operation on 
the grouped block, and separating the character block from the grouped block in 
a binarization process. 

20 While the invention has been shown and described with reference to a 

certain preferred embodiment thereof, it will be understood by those skilled in 
the art that various changes in form and details may be made therein without 
departing from the spirit and scope of the invention as defined by the appended 
claims. 
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